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Abstract 

A basic result in synchronization of linear systems via output cou- 
pling is presented. For identical discrete-time linear systems that are 
detectable from their outputs and neutrally stable, it is shown that a lin- 
ear output feedback law exists under which the coupled systems globally 
asymptotically synchronize for all fixed connected (asymmetrical) network 
topologies. An algorithm is provided to compute such feedback law based 
on individual system parameters. A dual problem is also presented and 
solved. 

1 Introduction 

A notable meeting point for many researchers from different fields is the topic 
synchronization. One of the reasons for that comes from the nature as syn- 
chronization in large networks of dynamical systems is a frequently encountered 
phenomenon in biology. Among many others, one can count synchronously dis- 
charging neurons, crickets chirping in accord, and metabolic synchrony in yeast 
cell suspensions. Another reason is the abundance of technological applications: 
coupled synchronized lasers, vehicle formations, and sensor networks, just to 
name a few. We refer the reader to the surveys [2TJ [TH [6l [12] for references and 
more examples. 

The main issue in studying the synchronization of coupled dynamical systems 
is the stability of synchronization. As in all cases where stability is the issue, the 
question whose answer is sought is Under what conditions will the individual 
systems synchronize? In a simplified yet widely-studied scenario, where the 
individual system dynamics are identical and the coupling between them is 
linear, studies focus on two ingredients: the dynamics of an individual system 
and the network topology. Starting with the agreement algorithm in [19) a 
number of contributions [TU1 EJ HS1 HI 13 H3] have gathered around the case 
where the weakest possible assumptions are made on the network topology at 
the expense of restrictive individual system dynamics. It was established in 
those works on multi- agent systems that when the individual system is taken to 
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be an integrator and the coupling is of full-state, synchronization (consensus) 
results for time-varying interconnections whose uniont0 over an interval are 
assumed to be connected instead of that each interconnection at every instant 
is connected. 

Another school of research investigates networks with more complicated 
(nonlinear) individual system dynamics. When that is the case, the restrictions 
on the network topology have to be made stricter in order to ensure stability 
of synchronization. Generally speaking, more than mere connectedness of the 
network has been needed: coupling strength is required to be larger than some 
threshold and sometimes a symmetrj0 or balancedness assumption is made on 
the connection graph. Different (though related) approaches have provided dif- 
ferent insights over the years. The primary of such approaches is based on the 
calculations of the eigenvalues of the connection matrix and a parameter (e.g. 
the maximal Lyapunov exponent) depending on the individual system dynamics 
[22"1 IT4] . In endeavor to better understand synchronization stability, tools from 
systems theory such as Lyapunov functions [H [5] , passivity [31 [T7] , contraction 
theory [15], and incremental input to state stability (<5ISS) theory [H] have also 
proved useful. 

This paper studies a broad class of linear systems under weak assumptions on 
the coupling structure and generalizes some of the existing results on synchro- 
nization. Namely, we consider identical individual discrete-time linear systems 
interacting via (diffusive) output coupling under a fixed (time-invariant) net- 
work topology. The contribution of the paper is in proving (via construction) 
the following basic result, which seems to have been missing from the literature. 
For a linear system^ that is neutrally stable and detectable from its output, 
there always exists a linear output feedback law that ensures the global asymp- 
totic synchronization of any connected (not necessarily symmetric nor balanced) 
network of any number of coupled replicas of that system. To fortify our contri- 
bution practically, we provide an algorithm to compute one such feedback law. 
Solving that problem will also yield us a solution to the dual problem where 
the coupling is of full state but the input injection to the system is through a 
(non-identity) B matrix. As expected for the dual case, detectability assump- 
tion will need to be replaced by stabilizability. It is worth noting that our main 
theorem makes a compromise result between the two previously mentioned cases 
(i) where synchronization is established for very primitive individual system dy- 
namics, such as that of an integrator, but under the weakest conditions on the 
network topology and (ii) where the network topology has to satisfy stronger 
conditions, such as that the coupling strength should be above a threshold, for 
want of achieving synchronization for nonlinear individual system dynamics. 

The remainder of the paper is organized as follows. Notation and definitions 
reside in the next section. We give the problem statement along with our as- 
sumptions in Section [3J In Section 2] we provide a preliminary synchronization 

x By union of interconnections we actually mean the union of the graphs representing the 
interconnections. 

2 A network is symmetric if the matrix representing it is symmetric. 
3 x + = Ax + u; y = Cx. 
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result on a network of linear systems with orthogonal system matrices. Then 
we generalize that result to establish our main theorem in Section O We work 
out the dual case in Section [51 



2 Notation and definitions 

The number of elements in a (finite) set S is denoted by #5. Let N denote the 
set of nonnegative integers. Let | • | denote 2-norm. Identity matrix in R™ xn is 
denoted by /„. A matrix Q £ R nxn is orthogonal if QQ T = Q T Q = I n - Orthog- 
onal matrices satisfy \Qv\ = \v\ for all v £ R n . Given C £ R mxn , B £ R nxm , 
and A £ R nx ™, pair (C, A) is observable if [C T A T C T A 2T C T . . . A i ~ n ~ 1 ^ T C T ] 
is full row rank. Pair (C, A) is detectable (in the discrete-time sense) if that 
CA k x = for some x £ R™ and for all k £ N implies lim^oo A k x = 0. Pair 
(A, B) is stabilizable if {B T ', ,4 T ) is detectable. Matrix A £ R" xrl is neutrally 
stable (in the discrete-time sense) if it has no eigenvalue with magnitude greater 
than unity and the Jordan block corresponding to an eigenvalue A with |A| = 1 
is of size oneQ Let 1 £ W denote the vector with all entries equal to unity. 
Kronecker product of A £ W nxn and B £ W xq is 



A®B:= 



auB ■ ■ ■ a\ n B 



a m\B ■ ■ ■ a mn B 



In the pages to come we will enjoy the properties {A(&B){C®D) = (AC)®(BD) 
(provided that products AC and BD are allowed), A®B + A®C = A®(B + C) 
(for B and C that are of same size) and \A <g> B\ = \A\\B\. 

Matrix P £ R" x ™ is an orthogonal projection onto the subspace range(P) 
if P 2 = P and P T = P. For an orthogonal projection P, if the columns of 
C T £ R nxm are an orthonormal basis for range(P) then P = C T C. Matrix 
V = I n — P is also an orthogonal projection and range(F) = range(P)" L . It is 
easy to sec that PV = VP = 0. 

A (directed) graph is a pair (A/", A) where A/" is a nonempty finite set (of 
nodes) and A is a finite collection of pairs (arcs) (rij, rij) with rii, rij £ M. A 
path from n% to ng is a sequence of nodes {ni, 712, . . . , ni} such that (n^, n^+i) 
is an arc for i £ {1, 2, ...,£— 1}. A graph is connected if it has a node to which 
there exists a path from every other node@ 

The graph of a matrix A := [Ay] £ W xp is the pair (M, A) where Af = 
{ni, 712, . . • , n p } and (n,-, rij) £ A iff A, y - > 0. Matrix A is said to be connected 
(in the discrete-time sense) if it satisfies: 

(i) Xu > and Ay > for all i, j: 



4 Note that A is neutrally stable iff there exists a symmetric positive definite matrix P such 
that A T PA - P < 0, [2]. 

5 Note that this definition of connectedness for directed graphs is weaker than strong con- 
nectivity and stronger than weak connectivity. 
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(ii) each row sum equals 1; 

(iii) its graph is connected]! 

For A that is connected, it is known that lim^oo A k = lr T where r 6 R p has 
nonncgative entries and satisfies r T l = 1 and r T A = r T . We mention that, 
in an interconnection of systems, if the matrix describing the network topology 
satisfies properties (i) and (ii) above, then the coupling between the systems is 
said to be diffusive. 

Given maps & : N -> K™ for i e {1, 2, . . . , p} and a map £ : N -> R'\ the 
elements of the set {Ci(') : i = 1> 2, . . ., p} are said to synchronize to £(■) if 
~ ~~ > as k — > oo for all i. 

3 Problem statement 

3.1 Systems under study 

We consider p identical discrete-time linear systems 

xf=Axi + Ui, yi=Cxi, i=l,2,...,p (1) 

where Xi G M" is the state, xf is the state at the next time instant, ui € K ra is 
the input, and j/i 6 K m is the output of the ith system. Matrices A and C are of 
proper dimensions. The solution of ith system at time k G N is denoted Xi(k). 
In this paper we consider the case where at each time instant only the following 
information 

p 

3=1 

is available to ith system to determine an input value where A := [A^] G W xp is 
the matrix describing the network topology. Matrix A has nonnegative entries, 
strictly positive diagonal entries, and rows summing up to one. That is, the 
coupling between systems is diffusive. 

3.2 Assumptions made 

We make the following assumptions on systems ([1} which will henceforth hold. 

(Al) A is neutrally stable. 
(A2) (C, A) is detectable. 

6 Recall that for continuous time applications, definition of connectedness is different: a 
matrix [7^] is considered connected (in the continuous-time sense) if jij > for i ^ j; each 
row sum equals 0; and its graph is connected. 
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3.3 Objectives 



We have two objectives in this paper. The first one is to find the answer to the 
question Does there exist a linear feedback law L G R nxm such that solutions of 
systems (Q]) with u,- L — Lz i; where Zi is as in globally synchronize to some 
bounded trajectory for all connected A ? Our second objective is, if the answer 
to the previous question is affirmative, to devise an algorithm to compute one 
such L. 



4 A preliminary result 

Consider p interconnected systems 

v 

it = Qti + QH T H Oj-ti), i = 1. 2, • . • , P (3) 

j=l 

with Q G M. nxn and H G M. mxn . We make the following assumptions on sys- 
tems ([3]) which will henceforth hold. 

(Bl) Q is orthogonal. 

(B2) HH T = I m . 

(B3) (H, Q) is observable. 

The following result can be implicitly found, for instance, in [5D1 Cor. 15]. 

Lemma 1 Given A S W xp that is connected, let r S R p be such that lim^oo A k - 
lr T . Then there exist c > 1 and a G (0, 1) such that \A k — lr T \ < ca k for all 
k e N. 

We also need the following result for later use. 
Lemma 2 Pair (H, Q) of ([3]) satisfies 
n— l 

Y[(I n -Q lT H T HQ<) 



<1. (4) 



i=0 

Proof. Note that Q lT H T HQ 1 is an orthogonal projection for i — 0, 1, . . . , n — 
1. Whence \I n - Q iT H T HQ l \ G {0, 1}. Now, suppose 0} is not true. Then 
there exists v G R™ with |v| = 1 such that 

|(/„ - Q {n ~ 1)T H T HQ"- 1 ) .-.(/„- ^i/)^ = 1 . 

For w G W 1 and an orthogonal projection P G M™ xn , if (7 n — P)w 7^ 77; 
then it must be that |(J„ — P)iy| < As a consequence we must have 

Q tT H T HQ l v = for all i. Thence = for all i. This means that v 

is orthogonal to every column vector of [H T Q T H T Q 2T H T . . . Q^ 1 " lT H T ]. 
This however is a contradiction for (H, Q) pair is observable. ■ 

We now provide a key result. 
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Theorem 1 Consider systems Suppose A is connected and let r € W be 
such that limfe^oo A k = lr T . Then solutions £$(•) for i — 1,2, . . . , p synchro- 
nize to 



£(k) : = (r T ® Q k ) 



fi(0) 



&(0) 



Proof. Let us stack individual system states to obtain x := [(£ £j ... £j] T . 
From ((3]) we obtain 



{Ip ® Q)(J P ® /„ + (A - / p ) ® (H T H))i 



(5) 



Let w(fc) := (/ p (g) Q- fc )x(fc), P fc := Q kT H T HQ k , and V fc := i„ - P fe for 
A; £ N. Observe that for each k, Pk is an orthogonal projection onto subspace 
range(Q fcT 7J T ) and 14 onto range((5 fcT i? T ) ± . From (O we can write 



w(fc + 1) = (ip <g> Vfc + A <8> Pfe)w(fc) . 
For fc, ft G N with fc > ft, let 

fe-l 



(6) 



*(*, ft) :=Y[(I P ®V T +A® P T ) 



with $(ft, ft) = i pn . Note that w(fc) = $(fe, ft)w(ft). We now establish the 
following: 



lim $(fc, ft) = lr T (gi J„ 



(7) 



for any fixed ft. Without loss of generality let ft = 0. For £, k e N with £ < k 
let us define 

M £)fe := ^ M (8) 

where 

tl e , k := {A/ : M = L fc _iL fc _ a • • - £o, i< G P}, #{i : L< - P} = . 

For instance, fi . 4 = {F 3 V 2 ^K,} and fi 2 . 4 = {KaV^fJ,, W ^iP,, P 3 V 2 V 1 P , 
V 3 P 2 PiV , P3V2P1V0, P3P2V1V0}. Observe that 



fc! 



{k-£)\l\ 



(9) 



Note that A/^ fe+1 = V r AM /)fc +i\M<-i,k for I G {1, 2, ... , fc}, M , fe+ i = V%Af 0>fc , 
and M^+i^+i = PkMk t k- We can write 



$(fc, 0) = ( A ^ ® 



(10) 
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and 

k 

J2 M *,k=In- (11) 

e=o 

Let a := |V^j_iV^_2 • • • Vq\- Lemma [5] guarantees that a < 1. We make the 
following observations. For all £, k, 

\M t>k \ < 1 (12) 

and 

\M i>k \ < ( k ( ) a^-' (13) 

for + -£>0. 

Let us first show (|T!Z1) . Suppose for some fc S N and all v € K n with |u| = 1 
we have 

fe 

\M e , k v\ 2 = 1 . (14) 

1=0 

Then we can write, since both V k and P k are orthogonal projections satisfying 
V k P k o. 

fc+i fe 

^|M,, fc+1 tf = \V k M 0>k v\ 2 + \P k M k , k v\ 2 + \V k M itk v + P k Mi_ hk v\ 2 
1=0 i=\ 

fc 

= \V k M 0tk v\ 2 + \P k M k , k v\ 2 + (\V k M itk v\ 2 + \P k M e „ hk v\ 2 ) 



Y (\ v kM e , k v\ 2 + \P k M ltk v\ 2 ) 



1=0 

fe 

Y \ M Ckv\ 

1=0 

1 . 



Hence, by induction, (I14|) holds for all k since it trivially holds for k — thanks 
to (fTTj) . We therefore have (fl"2")) as a direct implication of (|14[) . 

Now, we show (TT5]) . Let us be given some k > n — 1. Let then fco := k — n+1. 
We observe that 

\VkVk-!- "Vk-n+il = \Q koT V n ^Q ko Q koT V n ^Q ko ---Q koT VoQ ko \ 
= \Q koT V n -iV n - 2 ---V Q ko \ 

= \Vn-xVn-2---Vo] 
= a . 
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Hence for M £ Sle t k one can write 



\M\<a^~ l 

for \_{k + l)/n\-i> 0. Then by © and © we obtain (TTJ 

Now we are ready to show ([7]). Let us be given 8 > 0. Let c > 1 and 
er S (0, 1) be such that |A fe — lr T \ < ca k for all k G N. Such c and er exist by 
LemmaHJ Choose t 6 N such that ccr ^ < V 2 - Then choose fc* £ N such 

that 



E 

1=0 



~ 2c 



for all k > k* . Now, let us be given some k > k*. We write by (fTT)|) and (TTT|) 



|$(fc, 0)-lr T ®/„| = J]A £ ®M^-^lr T ®M, !fe 

k 

= ]T(A £ -lr T )®M^ 

r-i k 

< 1 ( A ' - lrT ) ® M '.fe I + E 1 ( A ' - lrT ) ® M ^ 



= ^ \A e - lr T \\M u \ + £ |A* - lr T \\M £ , k \ 

1=0 i=t* 

< c-£\M ( , k \+J2\^-lr T \ 



1=0 



< c E 



c- 



«=0 

'2c + 2 



E 



where we have employed (| 12|) and (|13p . Having shown l[7|). we can write 
lim |x(fc) - (lr T ® Q fc )x(0)| = lim |(J p ® Q fc )w(fc) - (lr T $ Q fe )w(0)| 



k—*c 



= lim |(/p(g)Q fe )$(/c, 0)w(0) - (lr T «)Q fe )w(0)| 
= lim |((I p <g>Q fe )(lr T <g>J„)-lr r ®Q fe )w(0)| 



lim |(lr T <g> Q fc - lr T ® Q fc )w(0)| 



(15) 
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where we used the fact that x(0) = w(0). Eq. (fT5| implies 
lim |&(A;)-(r T ®Q fe )x(0)| = 

fe — >oc 

for all i G {1, 2, ... , p}. Hence the result. ■ 

5 Synchronization via output feedback 

We are now ready to answer the question asked in the problem statement: 
Does there exist L G ]B> mxn such that solutions of systems (Q} with ui = Lzi, 
where Zi is as in ([2]), synchronize for all connected A? The answer, we will 
see, is affirmative and lies in a straightforward generalization of the key result 
(Theorem [1]) of the previous section. We also provide a simple algorithm to 
calculate such L. Let us begin with the following fact. 

Fact 1 Let F G R™ x " be a neutrally stable matrix with all its eigenvalues having 
unity magnitude. Then there exists R nxn 9 R = R T > such that F T RF = R. 

Proof. Since F has no Jordan block of size greater than one, it can be diago- 
nalized. Therefore there exist Z G C nx ™ anc l a diagonal matrix D s C nxn such 
that F = ZDZ^ 1 . Since the diagonal entries of D are all of unity magnitude, 

\D k x\ = \x\ for all x G M. n and k = 1, 2, Therefore there exist real numbers 

< a < b < oo such that 

a\x\ < \F k x\ < b\x\ , k = l, 2, ... 

Note that a 2 x T x < x T F kT F k x < b 2 x T x for all x and k. Let us define the 
compact set X := {X e W ixn : X = X T ,a 2 I n < X <b 2 I n ] and the continuous 
function / : X -» R as f(X) := \F T XF - X\. Finally let 

fe 

Xu-k-^F^F^ fc = l, 2, ... 

i=l 

By construction a 2 I n < X^ < b 2 I n and X^ = Xk for all k. Hence X^ G X . We 
now can write 

f(X k ) = \F T X k F-X k \ 

fe+l k 

= k- 1 ^2 F iT F l - ^2 F iT F' 

i=2 i=l 

= fc" 1 |F (fc+1)T F' £+1 - F T F\ 
< k^2b 2 . 

As a result we have lim^oo f(X k ) — 0. Since / takes only nonnegative values 
we deduce 

my ( x) = o. 
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Compactness of X together with continuity of / implies that minimum is at- 
tained Cor. 6.57]. Thus there exists R £ X such that f(R) = 0. ■ 



Algorithm 1 Given A £ R™ x " that is neutrally stable and C £ R mxn , we ob- 
tain L £ R nxm as follows. Let m < n be the number of eigenvalues of A with 
unity magnitude. Let ri2 := n — n±. If n\ — 0, then let L := 0; else construct L 
according to the following steps. 



Step 1: Choose U £ l"^ 1 and W £ W 
[U W^Ap W] 



satisfying 



F 






G 



where all the eigenvalues of F £ R™i x,l i have unity magnitude. (Assume, with- 
out loss of generality for our purposes, that CU is full row rank.) 



Step 2: Choose R £ R" lXni with R 
can do thanks to Fact\l\) 



R T > such that F T RF = R. (This we 



Step 3: Choose H £ R mx "i satisfying range(7J T ) = range(i?- 1 / 2 [/ T C T ) and 
HH T = I m . (Note that then matrix CUR~ 1 / 2 H T is invertible.) 

Step 4: Define L := UFR~ 1 / 2 H T {CUR~ 1 / 2 H T )~ 1 . 
Below is our main result. 

Theorem 2 Consider systems (pj. Let itj = Lzi where L £ W lXrn is con- 
structed according to Algorithm^ and z,i is as in ([2]). Then for all network 
topologies described by connected A, solutions Xi(-), for i = 1, 2, ...,p, syn- 
chronize to 



x(k) := {r T ®A k ) 



xi (0) 



where r £ MP is such that r T T 



x p (0) 
r T and r T l = 1. 



Proof. Let the variables that are not introduced here be defined as in Al- 
gorithm [T] Without loss of generality we assume that CU is full row rank. 
Since H T H is an orthogonal projection onto range(-ff T ) = range(i?~ 1 / 2 [/ T C T ), 
we can write H T HR- 1 / 2 U T C T = R- 1 / 2 U T C T . Taking the transpose we ob- 
tain CXJR- X I 2 E T E = CUR' 1 / 2 . Since CUR- X I 2 H T is invertible we obtain 
H = {CUR- 1 I 2 H T )- 1 CUR- 1 ' 2 . Therefore LCURr 1 ' 2 = UFR~ l / 2 H T H. 
Also, detectability of (C, A) implies that pair (H, Q) is observable for Q := 
R 1 / 2 FR~ 1 / 2 . Note that Q is orthogonal due to F T RF = R. 
We let W £R niXn and W* £ R" 2X ™ be such that 



[U W] 
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Note then that WU = I ni , W^W = I n2 , U^W = 0, and W^U = 0. Since 
u.j = Lzi, we can combine ([TJ and to obtain 2;^ = Axi+LCY^—i ^%j( x j~ x i)- 
By change of variables & := [R 1 / 2 0][U W]~ 1 x i and m := [0 I n . 2 ][U W]~ 1 x l we 
can write 

p p 
6+ = QZi + QH T Hj2*iM-Zi)+R 1/2 rfLCWj2^(Vj-Vi) (16) 

% + - G m . (17) 

Let A be connected and r e R p be such that linife^oo A fe = lr T . Then 
define w, : N — > M™ 1 as := Q~ k £i(k) and i = 1, 2, . . . , p. Let w := 

[u)f u> 2 ■ ■ ■ ^p] T and v := [rjf rfi . . . rjp] T . Starting from p^|) and (fT7| we 
can write 

w(fc + 1) = (I pni + (A - Ip) ® Q- k H T HQ k )) w(k) 
+ ((A - Ip) ® Q~ k ~ x MG k ) v(0) 

where M := fl^E/tzCW. Thence 

53 $(fc, t + 1) ((A - I P ) ® Q-^ X MG 



w(fc) = $(fc, 0)w(0) 
where 

$(fc, £) := J] (Vi + ( A - h) ® Q T H T HQ T ) 



v(0) (18) 



fe-i 



is the state transition matrix [2]. From Theorem [T] we can deduce that $(fc, f) is 
uniformly bounded for all k and £. Also, for any fixed £ we have lim^oo $(fc, £) = 
lr T (g) J ni . Moreover, Q fc is uniformly bounded for all A;, and G fe decays expo- 
nentially as k — > oo for all the eigenvalues of G are strictly within the unit circle. 
Therefore we can write 



fc-i 

k — >oo 



lim J2 $ ( fc > £ + !) (( A - 7 p) ® Q~ l ~ X MG l ) 

= J C lim $(fc, £ + l) \ ((A - J p ) $ Q- e - 1 MG i 



,k- 
1=0 K 



J2( lrT ® 7 «i) ((A - Jp) ® Q- l ~ x MG l 

1=0 

0. 



Then, by (fT5)) . we can write 



lim w(fc) = (lr 7 ® J ni )w(0) . 
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Therefore solutions synchronize to (r T <S>Q k )w(0). Moreover, by (fTT|) . there 
is no harm in claiming that solutions rji(-) synchronize to (r T (g) G fc )v(0) for G fe 
is decaying as k — > oo. We can conclude that solutions iCi(-) synchronize to 



£/iT 1/2 



Q fe 
G fc 



xi (0) 
afp(0) 



(r T ® ,4 fe ) 



xi (0) 
x p (0) 



Hence the result. 



6 Dual problem 

In this section we present a problem similar, in fact dual, to the one stated in 
Section [3] Consider p identical systems 



= A T a 



C T i 



i = 1, 2, 



P 



(19) 



where Xi £ R™ is the state and Ui € M m is the input of the ith system. Ma- 
trices A T and C T are of proper dimensions. Let pair (A T , C T ) be stabilizable. 
Suppose now that at each time instant the following information 



= X!^ 3 



(20) 



is available to ith system to determine an input value. Now the obvious question 
we ask is the following. Can we design a linear feedback law K 6 R mx ™ such 
that solutions of systems (|19p with Ui — Kzi, where Zi is as in (I20p , globally 
synchronize to some bounded trajectory for all connected A? The answer is the 
next result which follows from Theorem [2j 

Theorem 3 Consider systems (fTT))) . Let ui = L T Zi where L S U. nxm is con- 
structed according to Algorithm^ and Zi is as in (|20p . Then for all network 
topologies described by connected A, solutions Xi(-), for i = 1, 2, ...,p, syn- 
chronize to 



x{k) := {r 1 ®A kl ) 



si(0) 
x p {0) 



where r G 



such that r T — r and r 1 = 1. 
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